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Device and method for generating metadata from essence 

Field of the invention 

5 

The present invention relates to a method for processing 
multimedia data including the step of providing at least one 
selected essence data, wherein essence data represents in- 
formation being directly perceptible by a user. Furthermore, 
10 the present invention relates to a corresponding device for 
processing multimedia data . 

Background of the invention 

15 Multimedia data may include metadata being data about data. 
Metadata is a special kind of data, which is linked to other 
data called essence. Metadata is typically used as index 
message for essence. Essence is the basic data, such as text 
essence, picture essence, video essence, or audio essence. 

20 

The metadata structure is essentially characterized by two 
parts: metadata-essence (MD-essence) and metadata-link (MD- 
link) . MD-essence is part of a metadata, which is designed 
to be human-perceptible, and which serves as the proxy by 
25 which the metadata will be presented to the user in any user 
interface of systems employing metadata. MD-link is part of 
the metadata, which links to any kind of essence. 

A way how to generate efficient metadata is always an impor- 
30 tant issue for metadata applications. A possible way for ge- 
nerating metadata is to convert essence into metadata. In 
practice, some essence, such as text essence or thumbnail 
picture essence, contains a lot of compact information which 
can be utilized for metadata. Usually, content of essence 
35 can be converted directly into metadata essence. However, it 
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is a problem to generate MD-link data conveniently in case 
of conversion of essence into metadata. 

Summary of the invention 

5 

In view of that it is the object of the present invention to 
provide a device and a method for conveniently generating 
MD-link data, while generating metadata from essence. 

10 According to the present invention this object is solved by 
a method for processing multimedia data including the steps 
of providing at least one selected essence data, wherein es- 
sence data represents information being directly perceptible 
by a user, providing a metadata template to be used to form 

15 at least a first metadata, providing a list of links to a 

plurality of second essence data and/or a list of a plural- 
ity of second metadata and forming said at least first meta- 
data on the basis of said at least one selected essence data 
and said list of links and/or said list of second metadata 

20 by applying said metadata template. 

Furthermore, according to the present invention there is 
provided a device for processing multimedia data including 
first storing means for providing at least one selected es- 

25 sence data, wherein essence data represents information be- 
ing directly perceptible by a user, second storing means for 
providing a metadata- template to be used to form at least a 
first metadata, third storing means for providing a list of 
links to a plurality of second essence data and/or a list of 

30 a plurality of second metadata and processing means con- 
nected to that first, second and third storing means for 
forming said at least first metadata on the basis of said at 
least one selected essence data and said list of links 
and/or said list of second metadata by applying said meta- 

35 data- template . 
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Accordingly, there is provided a basic method and device for 
conversion of essence into metadata for users with pre- 
knowledge for generating MD-links. Additionally, there may 
be provided an advanced method for convertion of essence 
5 into metadata based on a relationship-chain between essence 
and metadata, wherein the user may be without any pre- 
knowledge for generating MD-links efficiently. In other 
words, the user is given an intelligent metadata editing 
method or an assistant tool for metadata editing. 

10 

Preferably, second metadata linked with the at least one se- 
lected essence data is used for forming the first metadata. 
This is an essential help for the user to edit the first 
metadata. He does not have to look through the whole list of 

15 current metadata to find content -related further informa- 
tion. Instead of this, the user obtains a valuable hint to 
closely content correlated essence from the second metadata. 
Thus he does not have to go through the whole list of cur- 
rent metadata but highly relevant essence data are proposed 

20 automatically. 

The at least first metadata may be formed by taking over the 
at least one selected essence' into a MD-essence space of the 
metadata- template . This means, that the essence data or part 
25 of essence data are simply transferred to the metadata- 
template without any transformation. 

The at least first metadata is advantageously formed by add- 
ing one or more MD-links of the second metadata into a MD- 
link space of the metadata- template . This means, that the 
30 MD-links are simply formed by transferring the MD-links from 
other metadata into the new metadata without transformation. 

Third metadata and/or third essence data linked with MD- 
links of the second metadata may be used for forming the MD- 
35 essence and/or metadata-links of the first metadata. There- 
fore, a relation-chain of links having any length may be 
used to automatically propose a convenient metadata. 
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Fortunately, a forming or editing process of the metadata is 
performed with the help of a graphic user interface (GUI) . 
Such a GUI represents a comfortable assistance tool for ed- 
5 iting metadata. 

Brief description of the drawings 

The present invention will now be described in more detail 
10 in connection with the attached drawings, showing in: 

Fig. 1 a schedule for converting essence into metadata ac- 
cording to a basic method of the present invention; 
and 

15 

Fig. 2 a schedule for converting essence into metadata ac- 
cording to an advanced method of the present inven- 
tion. 

20 Detailed description of prefered embodiments 

For conversion of essence into metadata, essence data can be 
directly converted into MD-essence. The problem is how to 
conveniently generate a meaningful MD-link for it. To solve 
25 this problem, a basic and an advanced method are described 

in the following, which utilize the relationship between ex- 
isting essence and metadata to generate a significant MD- 
link . 

30 A basic method, which converts an essence into metadata and 
utilizes other existing essence or metadata to set up meta- 
data references is composed as following: 

I. Basic method: 

35 

a) As shown in Fig. 1, the task of this basic method is to 
combine a selected essence 1 with a provided metadata 
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template 2. The metadata template 2 includes a MD-essence 
3 and MD-link(s) 4 . 

b) As further shown in Fig. 1, a graphic user interface 
5 (GUI) 5 can browse or operate the following components: 

the selected essence 1, the metadata template 2, a list 
of links to existing essences 6 and a list of current ex- 
isting metadata 7. 

10 c) Using a GUI 5 operation, the user may convert the se- 
lected essence 1 into metadata 2 through taking over es- 
sence 1 into MD-essence 3. The essence 1 can be a text, a 
picture (such as a thumbnail picture) , an audio or a 
video-clip. If the MD-essence 3 contains a picture, an 

15 audio or a video clip, the metadata 2 is a kind of rich 

metadata . 



d) After converting essence 1 into MD-essence 3, it still 
needs to generate the MD-link(s). Without MD-link(s) in- 

20 formation, metadata are meaningless. In this basic 

method, the user may browse a list of links to existing 
essences 6 and a list of existing metadata 7 with the GUI 
5. The user may select desired links to the present es- 
sence from the list of links to essence 6 and add the se- 

25 lected links to MD-link 4. Furthermore, the user may se- 

lect metadata from the metadata list 7 and generate a 
link information to the selected metadata, and add the 
generated link to MD-link 4. 

30 e) After above editing process, a new metadata is generated, 
which is based on the metadata template 2. Its MD-essence 
3 is taken over from selected essence 1 and its MD- 
link (s) 4 is generated from list of links of existing es- 
sence 6 and metadata 7 . 



According to this basic method, a selected essence 1 is con- 
verted into a new metadata 2, wherein the user has to do 
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most of the work of finding or generating the new MD-link (s) 
4. The user must generate a metadata link according to his 
own pre-knowledge or understanding. He sets up MD-link 4 
through selecting and generating a link message from 
existing essence and metadata. In this procedure, the user 
cannot use any assistant information to simplify his selec 
tion and judgment process. However, in a lot of cases it is 
difficult to generate efficient and correct MD-link by only 
using above basic method. Therefore, an advanced method is 
proposed here, which can make use of associated reference 
information to help the user to select efficient and sig- 
nificant MD-link (s) for the new metadata: 

II. Advanced method: 

a) As shown in Fig. 2, the advanced, method includes all 
functions and components of the basic method as described 
above in I . (a) - (e) . 

b) As alternative way to the basic method, in the advanced 
method, the user may search in a metadata database for 
all metadata 8, which are linked to the selected essence 

1. The metadata 8 have their own MD-essences 9 and MD- 
links 10. Each MD-link 10 directs to essence 1. 

c) The metadata 8 can be viewed and operated by GUI 5. 

d) The MD-essence 9 of metadata 8 can be used as additional 
reference material for editing MD-essence 3 of metadata 

2. For example, the user may take the MD-essence 9 to im- 
prove MD-essence 3 . 

e) The metadata 8 provides useful hints for users. Based on 
metadata 8, the user may generate improved reference link 
data for the new generated metadata 2. For example, be- 
sides MD-link 10, the metadata 8 may include an other MD- 
link 11, which links to another metadata or essence 12. 
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Within metadata 8 all MD-links 10, 11 are content- 
associated. Therefore, metadata/essence 12 and essence 1 
are closely content -related entities. Thus, meta- 
data/essence 12 is a good reference candidate for the new 
metadata 2. In this case, metadata 2 should have a refer- 
ence link, which directs to the metadata/essence 12. If 
the user decides to take over the MD-link (s) 11 as refer- 
ence link into metadata 2, he can simply add the MD- 
link(s) 11 to MD-link(s) of metadata 2. 

f) Further, the user may make use of the hint of metadata 8 
to find further content-related entities of essence 1, or 
reference link data of metadata 2. For example, the user 
may look for interested reference information in meta- 
data/essence 12 and generate MD-link to metadata 2. 
Thereby the user may find other associated meta- 
data/essence 13 and generate a possible MD-link for meta- 
data 2 on the basis of metadata/essence 13. 

g) The user completes all above steps under GUI 5 operation. 

In Fig. 2. entities 1, 8, 12, 13 ... form of a kind of rela- 
tionship-hint-chain. This relationship-hint-chain makes it 
possible to let the user easily find out associated refer- 
ence links for the new metadata 2. This is a fast way to get 
desired entities from hundreds and thousands of candidates. 

The basic method and the advanced method for converting es- 
sence into metadata may be employed in parallel. If the user 
has enough pre -knowledge for generating reference link data, 
the user may use the basic method described above in (I), 
otherwise, the user may use the advanced method described in 
(II) and based on the relationship-hint -chain to generate a 
significant metadata link. 

For better understanding of the above methods the following 
application examples are given: 
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1. A user will generate a new metadata based on an existing 
photo (essence 1) . The content of the selected photo is 
about Eiffel tower in Paris. At first, the user will con- 
5 vert the photo into MD-essence 3. If the original photo 

has a big format, the new generated MD-essence photo can 
be converted into a shrunk formatted picture, such as a 
thumbnail photo. Now the user has a metadata with a MD- 
essence part. Second, the user must set up significant 
10 reference links for this metadata according to one of the 

two methods : 

a) Based on the above described basic method, the user may- 
browse lists of all existing essences or metadata and 

15 manually generate MD- links to preferred essences or meta- 

data, such as a film about the Eiffel tower, a biographi- 
cal article about the designer of the Eiffel tower, a 
metadata which includes many useful reference links about 
the Eiffel tower and Paris, etc. The problem for this 

20 method is that if there are a lot of possible candidate 

essences or metadata, it is difficult for the user to 
generate reference links correctly and quickly. 

b) Based on the above described advanced method, the user 
25 does not need to browse all essences or metadata. The 

user only has to check existing metadata 8 which link to 
the selected Eiffel 'tower photo (essence 1) . If there 
exists any metadata 8 which points to the selected photo, 
the user may simply check all reference links 11 of the 

30 metadata 8. The user may look for preferred entities fol- 

lowing these reference links 11 and select interested 
references and set up MD- links 4 for the new created 
metadata 2 . When using the advanced method, the user may 
set up the same MD-link 4 as the above basic method, such 

35 as links to some films, pictures or articles about Eiffel 

tower and Paris. However, the advanced method is more ef- 
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ficient and faster in case of larger essence and metadata 
databases . 

2. A user will generate a new metadata based on a movie (es- 
5 sence 1) -"The Lost World (Jurassic Park II)". The user 

may analyse the whole movie and extract some thumbnail 
pictures, a video-clip or an audio clip as key represen- 
tative entity of the movie. After that the user may con- 
vert the thumbnail pictures, the video clip or the audio 

10 clip into a MD-essence 3 of the new metadata 2. For 

example, if the user converts a dinosaur picture into MD- 
essence 3 of the new metadata 2, he may use the advanced 
method to search for interested reference quickly from 
existing metadata, which points to the selected movie. By 

15 this way, the user may generate useful MD-links 4, for 

the new metadata 2, such as links to movies "Jurassic 
Park I", "Jurassic Park II", "Jurassic Park III", links 
to some dinosaur document movies or pictures or articles, 
as well as links to some metadata which contain summary 

20 links about a dinosaur topic. 

As can be seen from the above examples, both methods provide 
a comfortable assistant tool for metadata editing. 



